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EXECUTIVE  SUMMARY 


The  Mount  Weather/ Aberdeen  Proving  Grounds  tests  have  accomplished  the  following: 

•  Developed  a  visible  hyperspectral  imaging  system  configured  for  future  use  on  an  unmanned 
air  vehicle 

•  Successfully  integrated  the  hyperspectral  sensor  with  a  high  resolution  line  scanner  and  a  real¬ 
time  processor 

•  Demonstrated  real-time  cueing  of  high-resolution  panchromatic  image  chips  using 
hyperspectral  imaging  and  subspace  RX  anomaly  detection 

•  Demonstrated  Constant  False  Alarm  Rate(CFAR)  anomaly  detection 

•  Collected  numerous  fully  corrected  visible  hyperspectral  data  cubes  in  real-time 


INTRODUCTION 

In  recent  years  military  reconnaissance  and  surveillance  have  greatly  benefited  through  the  expanded 
use  of  multispectral  and  hyperspectral  sensors  by  exploiting  spectral  differences  between  critical  ground 
targets  and  local  backgrounds  as  a  detection  discriminant.  Technological  advances  in  computing  power, 
digital  imaging  and  algorithm  development  have  allowed  for  real-time  detection  and  cueing  of  anomalies 
based  on  this  premise.  These  developments  combined  with  the  results  of  NRL’s  (MOVIES)  [1]  and 
Dark  HORSE  [2-4]  programs,  have  led  to  a  follow  on  program  to  develop  a  visible  hyperspectral  imaging 
system  configured  for  future  use  on  an  unmanned  air  vehicle  (UAV).  While  the  sensor  system  has  been 
configured  for  the  Predator  UAV  it  will  provide  an  enabling  technology  for  numerous  other  existing 
and/or  future  UAVs,  Uninhabited  Combat  Air  Vehicles  (UCAVs)  and/or  manned  reconnaissance 
platforms. 

The  following  provides  an  overview  of  the  hyperspectral  sensor  system  and  two  recent  field 
experiments  in  which  it  was  employed.  The  system  hardware  components,  software  interface  and 
processing  methods  are  described  in  detail.  A  description  of  the  test  flight  experiments  is  given  and  a 
preliminary  analysis  of  the  collected  data  is  presented. 


Manuscript  approved  August  2,  2000. 
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DATA  ACQUISITION  SYSTEM 


The  hyperspectral  sensor  system  consists  of  a  hyperspectral  imager,  a  high  resolution  line  scanner,  a 
sensor  interface  computer  (SIC),  a  data  processing  computer  (DPC),  a  ground  station  computer  (GSC) 
and  a  system  user  interface.  A  block  diagram  of  the  system  is  shown  in  Figure  1 . 


Fig.  1  -Block  diagram  of  data  acquisition  system 

Hyperspectral  Sensor 

The  hyperspectral  sensor  consists  of  a  Schneider  70mm  f/2.2  IR-corrected  video  camera  lens,  an 
American  Holographic  VS  15  f/2.0  dispersive  imaging  spectrograph  and  a  Pixelvision  Pluto  back 
illuminated  CCD  focal  plane  array  (FPA).  The  sensor  is  shown  in  Figure  2  and  its  dimensions  are  shown 
in  Figure  3.  During  operation,  light  from  the  scene  is  imaged  onto  the  entrance  slit  of  the  spectrograph. 
Light  passing  through  the  slit  is  dispersed  and  then  reimaged  onto  the  FPA.  Thus,  a  hyperspectral  image 
of  the  entrance  slit  is  created  on  the  FPA  with  the  spatial  dimension  parallel  to  the  slit  and  the  spectral 
dimension  perpendicular  to  the  slit.  Scanning  the  slit  across  the  scene  of  interest  using  aircraft  motion 
gives  spatial  information  in  the  down-track  flight  direction  and  results  in  a  three-dimensional 
hyperspectral  data  cube.  The  FPA  consists  of  1024  x  1024  pixels  with  a  pitch  of  12|jm  and  a  depth  of  14 
bits  per  pixel.  While  the  FPA  is  1024  pixels  square,  only  512  of  the  spectral  pixels  are  used 
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Fig.  2  -  Hyperspectral  sensor 


Fig.  3  -  Sensor  dimensions(topview) 


EPA  Size: 

1024x1024 

Pixel  Depth: 

14  bits 

Pixel  Size: 

12  um 

Binning  (Spatial): 

1:1 

Binning  (Spectral): 

8:1 

Spatial  (X-track) 


Fig.  4  -  Focal  plane  array  dimensions  and  parameters 

corresponding  to  the  first  order  dispersed  light.  The  second  512  spectral  pixels  correspond  to  second  order 
light  and  are  not  read  out.  See  Figure  4.  In  addition  to  only  using  half  of  the  spectral  pixels,  a  long  pass 
wavelength  filter  is  employed  on  the  lens  to  eliminate  the  shorter  wavelength  second  order  light  from 
overlapping  the  longer  wavelengths  of  the  first  order.  During  real-time  operation,  binning  is  8:1 
spectrally  and  1:1  spatially  resulting  in  64  wavelength  bands  and  1024  spatial  pixels,  respectively.  It 
should  also  be  noted  that  due  to  a  design  error  by  the  spectrograph  manufacturer,  some  vignetting  occurs 
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at  the  FPA  causing  the  field  of  view  (number  of  spatial  pixels)  to  be  further  reduced  by  approximately  50 
pixels  on  one  end  of  the  FPA.  The  hyperspectral  sensor  is  designed  to  operate  in  the  visible  wavelength 
regime  from  400-1000nm.  The  spectral  resolution  of  the  system  is  approximately  9.4nm  when  employing 
8:1  spectral  binning  (required  for  real-time  processing)  but  is  capable  of  providing  a  spectral  resolution  of 
1.5nm  with  1:1  spectral  binning.  Thus,  during  real-time  operation,  spectral  resolution  is  limited  by  pixel 
bin  width  and  not  by  the  width  of  the  entrance  slit  or  FPA  pixel  size. 

The  data  rate  for  the  hyperspectral  sensor  is  calculated  as  follows.  There  are  1024  pixels  in  the  spatial 
dimension  and  30  bands  in  the  spectral  dimension  with  a  depth  of  2  bytes  per  pixel,  operating  at  a  frame 
rate  of  30  Hz,  the  data  rate  is  1.8  MBytes/sec. 


HSI:  (1024  pix)  x  (30  bands)  x  (2  bytes)  x  (30  fps)  =  1.8  MBytes  /  sec 

High  Resolution  Line  Scanner 

The  high  resolution  line  scanner  (Dalsa  CL-C8)  consists  of  a  one  dimensional  array  of  6000,  10|am 
square  pixels  with  a  pixel  depth  of  8  bits  per  pixel.  A  large  format  telephoto  lens  (Pentax  300mm  f/4.0), 
images  the  scene  of  interest  onto  the  one  dimensional  array  and  an  image  cube  is  collected  by  scanning 
the  array  across  the  scene  of  interest  using  aircraft  motion. 

The  data  rate  for  the  line  scanner  is  calculated  as  follows.  There  are  6000  pixels  each  with  a  depth  of 
one  byte.  Operating  at  a  frame  rate  of  1 80  Hz,  the  data  rate  is  1 . 1  MBytes/sec. 

LS:  (6000  pix)  x  (1  byte)  x  (180  fps)  =1.1  MBytes  /  sec 

Spatial  Resolution 

The  spatial  resolution  of  both  the  hyperspectral  sensor  and  the  high-resolution  line  scanner  is  determined 
by  a  combination  of  hardware  limitations  and  flight  parameters.  The  cross-track  and  down-track  ground 
sampling  distance  (GSD)  is  a  function  of  aircraft  altitude,  lens  focal  length  and  CCD  pixel  size.  In  the  case  of 
down-track  GSD,  aircraft  speed  and  camera  frame  rate  must  also  be  factored  into  the  calculation  of  GSD. 
For  all  data  presented  in  this  document,  the  cross-track  instantaneous  field  of  view  is  160  microradians  with  a 
total  field  of  view  of  9.4  degrees.  A  comparison  of  cross-track  GSDs  for  both  cameras  at  various  ranges 
(altitudes)  is  plotted  in  Figure  5.  The  plots  assume  that  the  two  cameras  have  the  same  total  field  of  view.  A 
typical  ground  speed  is  1 15  knots  with  the  hyperspectral  camera  operating  at  a  frame  rate  of  30Hz.  Due  to  the 

larger  physical  array  size,  the  line  scanner  offers  approximately  6x  better  spatial  resolution  for  a  comparable 

total  field  of  view  to  that  of  the  hyperspectral  camera.  This  is  achieved  by  means  of  a  large  format,  long  focal 
length  (300mm)  lens. 
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Fig.  5  —  Comparison  of  ground  sampling  distances  (GSD)  between  the  hyperspectral  and  line  scanner  cameras. 


Computer  System 

The  computer  system  consists  of  three  separate  computer  chassis  and  a  RAID  storage  system.  The 
sensor  interface  computer  (SIC)  contains  two  frame  grabber  cards  (one  for  the  hyperspectral  camera  and  a 
second  for  the  line  scanner),  a  422/232  serial  GPS  card  and  a  parallel  data  card  for  connecting  to  the  data 
processing  computer  (DPC).  Captured  images  are  sent  from  the  SIC  to  the  DPC  via  an  RS-422  cable. 
The  DPC  houses  two  quad  Share  boards,  a  RAID  controller  card  and  a  RS-422  parallel  connection  to  the 
RAID.  The  DPC  performs  all  calibration,  detection,  image  chipping  and  hyperspectral  data  archiving 
functions.  A  38.4  Gigabyte  RAID  system  provides  enough  storage  for  several  hours  of  record  time  for 
data  from  both  the  hyperspectral  sensor  and  line  scanner.  The  third  computer  is  the  ground  station 
computer  (GSC).  The  GSC  serves  as  the  primary  user  interface  providing  the  operator  with  a  three  color 
hyperspectral  waterfall  display  on  one  monitor  and  a  series  of  high  resolution  images  of  chipped 
anomalies  on  a  second  monitor. 
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Calibration 

Before  the  anomaly  detection  algorithm  can  be  run  on  data  acquired  by  the  hyperspectral  sensor,  the 
sensor  must  be  flat-fielded,  spatially  registered  and  spectrally  binned.  Flat-fielding  corrects  for  the  non¬ 
uniformity  in  pixel-to-pixel  photoresponse.  Spatial  registration  eliminates  optically-induced  image 
distortions  while  spectral  binning  eases  the  spectral  processing  requirements  of  the  DPC.  A  block 
diagram  of  the  calibration  procedure  is  shown  in  Figure  6. 


Fig.6  -  Calibration  block  diagram 

The  first  calibration  step  is  flat-fielding  of  the  collected  data.  Previous  analysis  of  data  taken  with  the 
Pixel  Vision  Pluto  camera  has  shown  that  there  is  enough  nonlinearity  in  each  pixel’s  response  that  a 
quadratic  correction  is  required  to  flat-field  the  sensor.  Therefore,  prior  to  flight,  three  calibration 
coefficients  were  derived  for  each  pixel.  This  was  done  by  focusing  the  sensor  onto  the  face  of  the 
integrating  sphere  and  collecting  image  frames  for  various  levels  of  luminance.  Thus,  a  model  of  each 
pixel’s  radiometric  response  was  determined.  The  model  was  then  used  to  determine  a  set  of  coefficients 
that  could  be  used  to  correct  for  spatial  variances  in  response.  Finally  a  quadratic  fit  was  used  to  estimate 
a  gain,  offset  and  quadratic  coefficient  for  each  pixel.  Specifically,  for  each  pixel  a  quadratic  fit  was 
made  to  a  plot  of  pixel  response  versus  normalized  source  intensity  for  the  eight  luminance  settings  used. 
During  operation  the  real-time  processor  computes  the  formula  (per  pixel): 

Yl  =  a+bX+cX2 

where  Yl  is  the  pixel  response  and  X  is  the  normalized  source  intensity.  The  coefficients  are  the 
offset,  ” a  ”,  the  gain,  “b  ”  and  the  quadratic  coefficient,  “c 
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After  flat-fielding,  the  collected  data  is  spatially  registered  to  correct  for  the  optical  distortion  of  the 
spectrograph.  The  sensor  is  pointed  at  a  source  consisting  of  twelve  broadband  light  sources  aligned  in  a 
row.  This  source  is  shown  in  Figure  7.  During  calibration  the  sensor  is  adjusted  so  that  the  line  of  lights 
is  aligned  parallel  with  the  sensor  slit.  Figure  8  shows  these  lights  are  evenly  spaced  in  the  crosstrack 


Fig.  7  -  Broadband  Fig.8  -  Spatial  misregistration  (left)  and  corrected  result  (right).  The 

calibration  source  figure  on  the  left  is  the  original  64  bands  x  1024  spatial  uncalibrated  data 

and  that  on  the  right  results  after  a  4-point  interpolation  registration 


direction  and  extend  vertically  over  most  of  the  spectral  dimension  (due  to  the  source  being  broadband). 
However,  it  can  also  be  seen  that  the  broadband  spectra  are  originally  tilted  or  not  completely  vertical. 
When  collecting  data,  this  distortion  problem  can  result  in  a  point  source  on  the  ground  appearing  to  shift 
spatially  when  viewed  in  different  bands.  Thus  the  problem  is  often  referred  to  as  spatial  misregistration. 

To  correct  for  this  spatial  misregistration,  code  has  been  developed  that  takes  the  data  from  a 
laboratory  measurement  (such  as  that  in  Figure  7)  and  derives  a  shift  value  in  the  crosstrack  direction  for 
every  pixel  in  the  array  (  64  x  1024  for  the  sensor).  The  algorithm  employed  is  a  four-point  interpolator: 

Y2(iJ)  =  j^hSf  (k)Y\{i-S-2  +  k,j) 

k=  0 
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where  S,  and  Sf  are  the  integer  and  fractional  parts  of  the  floating  point  shift  necessary  for  each  pixel.  The 
coefficients,  h ,  are  based  on  a  polynomial  interpolator  described  in  reference  [1],  The  result  of  applying 
the  correction  is  also  shown  in  Figure  8(right  hand  picture). 

Lastly,  the  data  is  spectrally  binned.  The  real-time  processor  selectively  bins  the  64  available  bands 
down  to  30  bands  and  passes  the  resulting  data  cube  on  to  the  detection  algorithm.  The  binning  is 
selectable  in  the  real-time  code  and  is  based  on  a  table  passed  to  the  code  at  run  time.  The  table  has  thirty 
entries  and  each  entry  has  two  values:  the  first  is  the  starting  band  number  and  the  second  is  the  number 
of  succeeding  bands  to  sum.  For  the  flights  presented  in  this  document,  we  chose  to  process  bands  28 
through  57  with  no  summing. 

Anomaly  Detection 

The  real-time  anomaly  detection  algorithm  used  is  a  subspace  RX  algorithm.  The  real-time  version 
of  the  RX  algorithm  was  developed  by  NRL  with  the  support  of  SCC,  Inc.,  Santa  Monica,  CA.  The 
algorithm  calculates  a  recursive  mean  vector,  m„,  and  covariance  matrix,  Kn,  for  each  pixel  using  the 
formulas: 

mn  =(1  +  azn 


Kn  =  (1  -  a) Kn  - 1  +  a(  1  -  a)(zn  -  /n„_,  )(zn  -  m„_,  )T 
a  =  2/(Neff+] ) 

where  z„  is  the  column  vector  of  spectral  components  of  the  n"'  pixel  and  Neg  is  the  sample  average 
(steady  state).  Normal  RX  detection  computes  a  detection  result,  r,„  for  the  n  pixel  using  the  formula: 

rn  =  (. Z„  -  mn )T  K~x  ( zn  ~mn ) 

The  SCC  algorithm  uses  a  variation  of  RX  detection  where  the  inverse  covariance  matrix,  AT1,  is 
calculated  using  the  formula: 


K~'  =QA~'QJ 

where  Q  is  a  matrix  formed  from  the  eigenvalues  of  the  covariance  matrix  with  the  form 
{ Q  =  lli '  Sj]  }  and  where  J  is  the  number  of  spectral  bands  and  A  is  a  diagonal  matrix  with  elements  equal 
to  the  eigenvalues  of  the  covariance  matrix  with  the  form  {A  =  diag[k\  XJ\ }. 
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Then  by  defining  the  principal  components,  x„,  using  the  formula: 


xn=QT(zn  ~mn) 

we  can  finally  calculate  the  detection  result,  rn,  with  the  formulas: 

rn  =  (i„  -m„)TQA'1eT(i„  -m„) 


where  {xn(i);  i=l, ...,/}  are  the  elements  of  the  principal  component  vector  xn. 

Constant  False  Alarm  Rate  Detection 

A  typical  problem  that  is  encountered  when  examining  multiple  data  sets  processed  through  various 
spectral  anomaly  detectors  is  the  inability  to  quantitatively  assess  or  predict  detection  performance  based 
on  the  numerical  output  of  the  algorithms.  Since  detector  outputs  may  vary  considerably  under  different 
experimental  conditions,  it  is  not  possible  to  obtain  consistent  detection  results  by  selecting  a  single 
numerical  threshold  for  a  given  sensor  and  algorithm.  Rather,  it  becomes  necessary  to  select  a  threshold 


Detector  Threshold 


Fig.9  -  SSRX  detector  tail  nonlinear  least-squares  fit.  Tail  probabilities  are 
presented  on  a  base  10  logarithmic  scale. 
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based  on  a  predictable  measure  of  detector  performance.  One  such  measure  that  is  of  particular  interest  in 
remote  sensing  studies  is  the  probability  of  false  alarm.  This  is  a  technique  whereby  detector  outputs 
approximating  a  mixture  of  yj  distributions  can  be  normalized  into  constant  false  alarm  rate  (CFAR) 
units,  thus  allowing  the  selection  of  a  threshold  that  yields  a  consistent  probability  of  false  alarm  across 


Detector  Threshold 


Fig.  10  -  SSRX  detector  tails  of  three  different  data  sets.  Detector  thresholds 
correspond  to  different  tail  probabilities  along  each  curve. 


data  sets. 

Ideal  detector  outputs  from  statistical  detection  algorithms,  such  as  subspace  RX  (SSRX)  should 
approximate  a  known  distribution.  Algorithms  based  on  RX  spectral  detection  should  ideally  produce 
%2(k)  =  F(k/2,  1/2)  output,  where  k  is  the  number  of  processed  spectral  dimensions.  However,  sensor 
artifacts  and  data  outliers  produce  output  that  is  far  from  ideal,  so  a  more  general  distribution  is  required 
in  order  to  formulate  an  appropriate  model. 

A  typical  SSRX  detector  tail  probability  (Figure  9)  conforms  to  a  general  gamma  distribution  at  lower 
thresholds,  but  the  extended  tail  is  nearly  exponential  or  T(l,  X).  This  observation  motivates  a  detector 
distribution  based  on  the  mixture  of  two  gammas,  where  the  first  gamma  models  the  background  clutter 
and  the  second  models  all  other  scene  constituents.  The  following  dual  gamma  distribution  is  proposed: 

Q(t)  =  w  Q,(r;  ku  X{)  +  (I  -  w)  Q 2(r;  k2,  X.) 

Qi  ~  r(&i>  X) 

Ch  ~  r(k2,  X2) 
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Where,  given  any  detector  threshold  t  >  0,  we  may  regard  the  tail  probability  Q(t)  =  P{T>t}  as  the 
probability  of  false  alarm  with  T~w  T(ki,  X\)  +  (1  -  w)  T(k2 ,  X 2 ).  The  parameters  ku  X\,  k2,  Xi  and  w  are 
determined  using  nonlinear  least-squares  regression. 

For  the  purpose  of  detecting  targets,  it  is  important  to  obtain  a  good  fit  to  the  detector  tail  probability 
at  higher  threshold  values  (i.e.,  lower  false  alarm  rates).  Unfortunately,  because  higher  thresholds 
correspond  to  outliers  or  relatively  rare  scene  constituents,  the  detector  tail  probability  tends  to  be  very 
sparse  in  the  region  of  interest.  Therefore,  it  is  necessary  to  increase  the  sensitivity  of  the  fitting 
algorithm  to  the  tail.  A  simple  and  effective  solution  is  to  fit  the  logarithm  of  the  tail  probability. 

Once  a  suitable  dual  gamma  fit  is  obtained,  the  detector  data  set  must  be  normalized  into  an 
operationally  useful  range.  This  goal  is  easily  accomplished  by  transforming  each  detector  threshold  t 
into  its  corresponding  tail  probability  Q(t)  under  the  dual  gamma  model.  Normalized  detector  tail 
probabilities  approximate  an  exponential  distribution  with  a  constant  scale  parameter  and  therefore  have  a 
constant  false  alarm  rate  (compare  Figure  10  with  Figure  1 1). 


Fig.  11  -  Normalized  SSRX  detector  tails  of  the  three  data  sets  shown  in 
Figure  10.  The  exponential  tails  are  linear  on  a  logarithmic  scale.  Within  an 
acceptable  margin  of  error,  normalized  detector  thresholds  correspond  to  the 
same  tail  probability  along  each  curve. 
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Fig.  12  -  (Top)  Waterfall  display  with  anomalies  shown  as  bright  green  pixels.  (Bottom)  Chipped 
images  of  detected  objects  (red  boxes  in  waterfall  display) 
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Since  target  thresholds  typically  fall  in  the  range  10  2  <  Q (r)  <  10'4,  it  is  more  convenient  to  specify 
thresholds  in  terms  of  —  logio(Q(t))  or  CFAR  units.  An  example  of  an  application  where  CFAR  units  are 
preferable  to  tail  probabilities  is  a  graphical  user  interface  for  spectral  anomaly  detection  software 
(Figure  12). 

So  that  a  detector  CFAR  normalization  can  be  determined,  a  training  stage  is  run  prior  to  SSRX 
anomaly  detection.  This  is  accomplished  by  flying  over  an  area  that  is  typical  of  the  background  and  is  as 
free  of  anomalies  as  possible.  An  anomaly  (signal)  in  this  case,  spans  a  broad  range  of  objects  that  are 
spectrally  different  from  the  rest  of  the  background  (clutter).  Once  the  training  stage  is  complete,  the 
CFAR  is  set  by  the  user.  Upon  detection,  all  anomalies  are  subject  to  a  spatial  filter  that  passes  only  those 
cued  pixels  with  appropriate  dimensions.  If  “passed”,  a  box  is  placed  around  the  object  in  the  waterfall 
display  (Figure  12)-“Top”  and  a  corresponding  256x256  pixel  chip  from  the  high  resolution  line  scanner 
is  displayed  (Figure  12)-“Bottom”.  Chipping  is  constantly  updated  and  only  the  most  recent  high- 
resolution  chips  are  displayed.  All  chips  are  saved  and  may  be  “highlighted  by  the  user  as  being  of  high, 
medium  or  low  priority  for  later  viewing  by  use  of  the  left,  middle  and  right  mouse  buttons. 

Flight  Testing 

For  flight  testing  on  a  U-21  aircraft,  both  cameras  were  mounted  side  by  side  on  a  shock  mounted 
phenolic  plate,  attached  to  a  metal  housing  crate  and  inserted  into  a  sensor  bay  beneath  the  aircraft  (see 
Figures  14&15).  Power  supply  and  fiber  optic  data  cables  were  routed  from  the  bay  into  the  aircraft  cabin 


Fig.  13  -  U21  aircraft  Fig.  14  -  Sensor  bay  closeup 
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where  rack  mounted  computers  and  user  interface  controls  were  installed. 

Data  collection  proceeded  as  follows.  With  the  cameras  mounted  beneath  the  aircraft  in  a  nadir 
pointing  direction,  images  were  acquired  in  a  push-broom  manner  such  that  the  spectrograph  entrance  slit 
was  perpendicular  to  the  motion  of  the  aircraft.  As  the  aircraft  traveled,  successive  images  of  the  slit  built 
up  an  image  of  the  target  area  in  a  waterfall  display.  The  speed  of  the  aircraft  was  chosen  to  be  as  slow  as 
possible  due  to  the  relatively  slow  frame  rate  of  the  hyperspectral  camera,  to  simulate  typical  operating 
speeds  of  a  Predator  UAV  and  to  prevent  pixels  from  becoming  overly  elongated  in  the  down-track 
direction.  It  should  be  noted  that  flying  slowly  also  tended  to  pitch  the  aircraft  up  at  a  small  angle.  As  a 
result,  the  scene  being  imaged  is  actually  that  of  the  ground  slightly  forward  of  the  aircraft. 

The  following  table  provides  an  overview  of  system  specifications  for  the  hyperspectral  sensor  and 
controller,  the  high  resolution  line  scanner  and  the  real-time  processor.  It  also  lists  some  typical  flight 
parameters. 
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Table  1  -  Sensor  Specifications 


Hyperspectral  Sensor  and  Controller 

Spectrometer  Type 

Imaging  Grating,  12|im  Slit 

Wavelength  Range 

400-1000nm 

Lens 

70mm  f/2.2  IR  Corrected,  C-mount 

CCD  Focal  Plane  Array 

1024  x  1024  Pixels 

Pixel  Size 

12(xm2 

Pixel  Depth 

14  bit 

Frame  Rate 

50  Hz  (30-40  Hz  Typical) 

High  Resolution  Line  Scanner 

Camera  Type 

Line  Scanner 

Wavelength  Range 

Visible 

Lens 

Large  Format  300mm  f/4.0 

CCD  Array 

6000  x  I  Pixels 

Pixel  Size 

Pixel  Depth 

8  bit 

Frame  Rate 

Max.  5  kHz  (180  Hz  Typical) 

Real-Time  Processor 

Platform 

Pentium  III,  500  MHz 

Algorithm 

Subspace  RX  with  Spatial  Filtering 

Typical  Fli 

ght  Parameters 

Altitude(feet) 

6500,  15500 

Air  Speed 

1 1 5  knots  typical 

Hyperspectral  Ground  Pixel  Size 

Down-track:  1.5m,  3.2m 

Cross-track:  0.3m,  0.8m 

High  Resolution  Line  Scanner 

Down-track:  0.2m 

Cross-track:  0.06m,  0.15m 
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FIELD  DATA 


Two  separate  data  collections  took  place  in  June  and  August  of  1999.  The  first  collection  was  over 
both  Mount  Weather,  Virginia  and  Aberdeen  Proving  Grounds  (APG),  Maryland  and  took  place  over  the 
course  of  two  days.  The  second  collection  also  lasted  two  days  but  was  entirely  over  Aberdeen  Proving 
Grounds.  In  each  of  the  collects,  numerous  military  vehicles,  trailers,  camouflage  nets,  calibration  panels 
and  various  cultural  objects  comprised  the  target  array.  GPS  coordinates  for  most  of  the  targets  were  also 
provided.  Data  logs  for  all  flights  are  shown  in  Appendix  I. 

June  Collect 

The  Mount  Weather/ APG  data  was  collected  June  22-23  under  mostly  sunny,  late  morning  and  mid- 
afternoon  lighting  conditions.  The  target  area  at  Mount  Weather  was  an  open  field  surrounded  by  forest 
on  three  sides  and  a  parking  lot  and  dormitories  on  the  fourth.  Military  vehicles  and  camouflage  netting 
were  placed  along  the  tree  line  and  included  a  5-ton  truck  and  Hummer  transport  vehicles.  A  trailer  was 
attached  to  one  of  these  vehicles  and  camo  netting  was  placed  on  two  others.  Non-military  vehicles 
included  two  white  tractor  trailers,  and  a  white  truck  trailer.  A  picnic  shelter,  a  concrete  pad  and  the 


Mount  Weather  Target  Array 
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Fig.  15  -  Array  of  targets  at  Mount  Weather  site,  June  1999 
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comer  of  a  building  were  permanent  structures  whose  GPS  coordinates  were  also  recorded.  Figure  9 
shows  relative  target  locations  for  the  array.  Photographs  of  some  of  the  Mount  Weather  targets  are 
shown  in  Appendix  II. 

Only  two  targets  were  placed  at  APG,  a  FROG-7  rocket  launcher  and  a  T-72  Russian  tank.  Unlike  the 
Mount  Weather  site  where  targets  could  be  approached  from  any  direction,  APG  required  a  fixed 
approach  due  to  airspace  safety  and  security  issues.  The  GPS  coordinates  of  the  two  targets  were  not 
recorded.  Photographs  of  some  of  the  Mount  Weather  targets  are  shown  at  the  end  of  this  section  in 
Figures  12  and  13. 

The  sensor  system  used  during  the  June  collects  at  Mount  Weather  and  APG  was  a  subset  of  the 
complete  system  (Figure  1)  subsequently  used  at  APG  in  August.  Only  the  hyperspectral  camera  and 
computers  running  the  real-time  algorithm  were  installed.  Image  chipping  from  the  Dalsa  line  scanner 
was  not  implemented  at  this  time  because  the  hyperspectral  camera  itself  had  not  been  fully  tested. 
Hyperspectral  sensor  characterization  was  the  main  objective  of  the  June  flight  tests. 

During  the  June  collects,  field  data  was  taken  at  6500  and  15500  feet  with  the  aircraft  heading  into  the 


Downtrack 


Crosstrack 

Usable  swath 
is  ~ 800  pixels 
from  150-949 


Target  Area 


Downtrack 


Target  Area 


Fig.  1 6  -  Examples  of  Mount  Weather  data  at  6500(top)  and  1 5500  feet(bottom) 
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dimensions  of  the  upper  data  set  are  approximately  250  meters  cross-track  by  3000  meters  down-track. 

August  Collect 

The  August  10-11  target  array  at  APG  was  comprised  of  a  much  larger  selection  of  military  vehicles 
than  the  previous  June  collect  and  also  included  an  assortment  of  calibration  panels,  tarps  and  disturbed 
earth.  Targets  included  IRAQI  ZSU-23/4  anti-aircraft  artillery,  BMP-1  Soviet  infantry  vehicles, 
DIVITS,  T-72  Russian  tanks,  M998,  BTR-70  Soviet  armored  vehicles,  GAZ  66  Soviet  trucks,  T-55  tank, 
Hummer  transport  vehicles,  5-Ton  truck  and  a  FROG-7  rocket  launcher.  The  relative  target  positions  for 
the  array  are  shown  in  Figure  1 1 .  Many  of  these  vehicles,  panels  and  tarps  are  shown  in  Appendix  II. 

The  full  sensor  system  (Figure  1)  was  used  during  the  August  data  collects.  This  included  the 
hyperspectral  camera,  the  high  resolution  line  scanner,  and  the  complete  real-time  processing  system  with 
SSRX  anomaly  detection  and  subsequent  cued  image  chipping.  A  total  of  36  files  were  acquired.  Thirty 
of  these  files  were  calibrated  data  sets  collected  while  running  the  SSRX  anomaly  detection  algorithm. 
Six  of  the  collected  files  were  raw  data.  Altitudes  varied  from  6500  to  15500  feet.  Unfortunately  cloud 
cover  was  prevalent  for  a  majority  of  the  missions  at  15500  feet.  Airspeeds  were  comparable  to  the 
missions  conducted  in  June.  Due  to  the  requirement  to  fly  at  lower  altitudes  and  the  relatively  slow  30Hz 
frame  rate  of  the  hyperspectral  camera,  pixels  were  elongated  with  down-track  to  cross-track  aspect  ratios 
of  7:1  and  4:1  at  6500  and  15500  feet,  respectively.  The  cross-track  GSDs  were  0.3  meters  and  0.8 
meters  at  6500  and  15500  feet,  respectively.  Typically  the  number  of  frames  captured  for  each  pass  was 
between  400  and  3000  giving  a  down-track  swath  between  800  and  6000  meters. 

The  high  resolution  Dalsa  line  scanner  operated  at  a  180  Hz  frame  rate  with  a  cross-track  GSD  of 
0.05  meters  at  6500  feet  and  0.15  meters  at  15500  feet.  The  Dalsa  linescan  pixels  were  also  elongated 
with  the  same  relative  aspect  ratios  as  the  hyperspectral  sensor. 
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RESULTS  AND  DISCUSSION 


Due  to  cloud  cover  and  other  adverse  environmental  conditions  during  the  August  Aberdeen  flights, 
the  June  Mount  Weather/ APG  data  was  found  to  be  of  better  quality.  Therefore,  analysis  has  focused  on 
the  June  data  and  that  is  what  is  discussed  here.  A  preliminary  analysis  of  the  data  is  presented  below. 
Data  sets  taken  at  6500  and  15500  feet  are  shown  in  the  previous  section  (Figure  10).  A  close-up, 
broadband  image  of  the  circled  target  area  is  shown  in  Figure  18  along  with  a  RGB  principal  component 

Broadband  reference  image  RGB  display  of  selected  principal  components 


Trailers  5-ton  HMWIWV  Pads  Camo  Trailer  Camo 

Fig.  18  -  Mount  Weather  target  site  in  broadband(left)  and  principal  components(right)  with  target  positions  indicated 

image  indicating  relative  positions  of  targets  of  interest. 

The  plots  in  Figure  19  indicate  that  the  sensor  performance  is  good.  By  plotting  the  square  root  of 
the  first  30  principal  components,  the  clutter-limited  modes  can  easily  distinguished  from  noise-limited 
modes.  By  back-projecting  the  noise  limited  modes  to  30-band  space  an  estimate  of  the  noise  floor  can  be 
obtained.  The  resulting  RMS  spectral  noise  estimate  is  more  than  two  orders  of  magnitude  smaller  than 
the  spectral  mean  giving  an  estimated  spectral  SNR  of  approximately  500. 

While  the  in-flight  spectral  calibration  provided  a  flat  field  that  looked  “good  to  the  eye”,  a  spectral 
color  variation  in  the  cross-track  dimension  can  be  noticed  upon  observing  the  leading  order  principal 
components.  The  color  variation  takes  the  form  of  a  shading  artifact  that  is  seen  in  several  of  the 


“Shading”  artifacts  due  to  crosstrack  color  change  are  evident  in  several  PC  images  (e.g.,  2,4, 5, 9) 


Fig.  20  -  Principal  components  of  in-flight  calibrated  data.  Shading  is  prominent  in  many  of  these  components. 
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Fig.  21  -  Indications  of  spectral  variations  in  cross-track  dimension 


components  in  Figure  20.  Further  analysis  indicates  that  the  mean  spectra  of  the  pixels  along  the  cross¬ 
track  dimension  are  significantly  different  on  both  sides  of  the  swath.  Figure  21  shows  the  normalized 
difference  vegetation  index  (NDVI)  map  which  is  essentially  a  map  of  the  green  vegetation  content  of 
each  pixel.  It  is  seen  that  even  in  cross-track  swaths  where  there  is  nothing  but  vegetation,  there  is  a 
distinct  difference  in  the  NDVI  on  the  left  and  right  hand  sides.  The  upper  plot  in  Figure  21  is  the  mean 
calibrated  spectral  intensity  of  eight,  100  pixel  bins  of  a  swath  of  vegetation.  Variations  in  spectra  are 
largest  on  the  right  side  of  the  swath.  The  lower  plot  uses  line  50  near  the  left  hand  side  of  the  swath  as  a 
reference  to  calculate  the  relative  error  in  these  vegetation  spectra.  It  is  apparent  that  the  differences  are 
not  just  illumination  scaling  but  a  result  of  color  change. 

To  fix  the  spectral  variation,  a  scene-based  recalibration  has  been  employed.  By  measuring  the 
relative  change  in  green  vegetation  intensity  along  the  cross-track  position  for  each  of  the  30  bands,  the 
in-flight  spectral  calibration  is  gain  corrected.  The  relative  change  for  all  bands  is  plotted  in  Figure  22 
using  pixel  50  as  the  reference.  By  applying  the  gain  to  the  original  data  cube  and  then  examining  the 
image  principal  components  (Figure  23),  it  is  evident  that  the  recalibration  has  removed  the  shading 
artifacts  (color  variations)  present  in  the  original  flight  calibrated  data. 

Figure  24  (top)  shows  an  RBG  display  of  another  hyperspectral  data  set.  Figure  24  (bottom)  is  the 
SSRX  anomaly  detection  results,  showing  the  anomalous  pixels  in  red.  Green  boxes  indicate  those 
anomalies  that  have  also  passed  the  size  requirement  of  the  spatial  filter.  It  should  be  noted  that  the 
SSRX  anomaly  output  not  only  reveals  the  targets  but  also  several  false  alarms.  Of  the  false  alarms,  14 
are  small  cultural  objects  and  45  are  natural  objects.  Figure  25  is  the  same  data  set,  but  it  has  undergone 
the  aforementioned  scene-based  recalibration.  The  false  alarms  are  significantly  reduced  to  eight  cultural 
objects  and  eleven  natural  objects  while  all  targets  remain. 
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Scene-based  recalibration  significantly  reduces  “shading”  artifacts  in  leading-order  PC  images 


Fig.  23  -  Principal  components  from  scene  based  recalibration.  Shading  artifact  is  corrected. 
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Anomaly  Detection  Test  Results: 
Flight-Calibrated  30-Band  Image  m02p04 


Fig.  24  -  In-flight  calibration  of  anomaly  detection  at  Mount  Weather  site  with  targets  indicated 
and  a  significant  number  of  false  alarm  cues 


Anomaly  Detection  Test  Results: 
Re-Calibrated  30-Band  Image  m02p04 


Fig.  25  -  Recalibrated  anomaly  detection  at  Mount  Weather  site.  False  alarms  are  significantly 

reduced. 
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SUMMARY 


Successful  integration  of  a  VIS/NIR  hyperspectral  sensor  and  high  resolution  line  scanner  with  real¬ 
time  anomaly  detection  and  image  chipping  has  been  accomplished.  Good  sensor  performance  is 
indicated  by  the  low  level  of  striping  and  the  high  SNR  in  the  collected  images.  Numerous  fully  corrected 
visible  hyperspectral  data  cubes  have  been  collected  in  real-time.  Real-time  cueing  of  high-resolution 
panchromatic  image  chips  using  hyperspectral  imaging  and  subspace  RX  anomaly  detection  has  been 
demonstrated.  A  spectral  color  variation  has  been  observed  in  the  cross-track  dimension  of  the  leading 
order  principal  components  but  it  has  been  shown  that  this  can  be  corrected  through  a  post-flight  scene 
based  recalibration.  Upon  doing  so,  false  alarms  are  significantly  reduced. 
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Comments 

don’t  know  if  we  got  the  target  area,  CFAR=3.0, 
calibrated  data 

still  looking  for  target  area 

got  it,  good  pass 

got  it,  CFAR=2.0,  calibrated  data 

missed  it 

over  calibration  panel,  don’t  know  if  we  got  the  whole 
panel  area 

got  it,  raw  data  collect,  calibration  panels 

got  it,  target  area 

change  altitude,  calibrated  data,  CFAR=10,  just  missed  it 

rolled  a  bit  over  targets,  calibrated  data,  CFAR=2.0 

good  pass  over  target  area 

computer  glitch(no  file) 

raw  data  collect,  aircraft  rolled  at  target  area 

raw  data  collect,  aircraft  rolled  slightly 

raw  data  collect,  aircraft  roll 
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Gnd.  Speed  Direction  Alt.  Comments 

File(year-date-timeEST ) _ (knots) _ (heading) _ (feet) _ 
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Direction  Alt.  Comments 

File(year-date-timeEST)  Gnd.  Speed  (heading)  (feet)  _ 


Appendix  II 
TARGETS 


Figure  1 :  Mount  Weather  target  vehicles 
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Figure  3:  Calibration  and  target  panels  used  at  APG  in  August,  1999 
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